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Sir: 

1. COPY OF PRIOR APPLICATION 

Attached is a true copy of the prior application as originally filed, including: 
[3 Abstract 

(3 Specification and claims as originally filed ( 52 pgs.) 

[3 Signed declaration or oath as originally filed 

[3 Sheets of Drawings: J4. (3 Informal □ Formal 

□ Verified Statement Claiming Small Entity Status 

2. STATEMENT OF INVENTORSHIP 

This Rule 53(b) application discloses and claims only subject matter disclosed in the prior application whose particulars 
are set out above and the inventors in this application are: 

[3 the same 

□ less than all of the inventors named in the prior application. Petition is hereby made requesting deletion as 
inventor(s) of the following who is/are not inventor(s) of the invention being claimed in this Rule 60 application: 

1. 2. 

3. 4. 



3. RELATE BACK - 35 U.S.C. 1 20 

|3 Amend the specification by inserting before the first line the sentence: 

- - This is a [3 Continuation [~| Division of co-pending application 
(3 Serial No. 09/439.482 filed November 12. 1999 . 

□ International Application No. filed on and which designated the U.S. - - 

[3 The Examiner is requested to review the references cited in the above-noted prior application and 
to make those references of record in the instant application. 
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4. PRIORITY CLAIM 



□ 



Priority is hereby claimed under 35 U.S.C. 1 19/365 based on prior foreign applications) No(s).: 



filed in (country) on ; and 



in (country) on , respectively. 



□ 



Certified copy/copies is/are attached. 



□ 



Certified copy/copies already filed on 
in prior U.S. application, Serial No. 



, filed on 



5. ASSIGNMENT 

[X] The prior application is assigned of record to: E-color. Tnc. 
Q Attached is an assignment to: . 

6. SMALL ENTITY STATUS 

[x] Verified Statement(s) establishing "small entity" status under Rules 9 and 27: 

£3 has been filed in parent application and such status is still proper and desired (37CFR 1.28(a)). 
Q is filed herewith. 

7 MAINTENANCE OF COD EPENDENCY OF PRIOR APPLICATION 

□ Petition, fee and response to extend the life of the copending prior application to 

□ is being concurrently filed in that prior application (see item 1 1). 

□ was previously filed in that prior application. 
|~] is not necessary. 

8. POWER OF ATTORNEY 

The power of attorney in the prior application is to Paul Backofen, Reg. No. 42,278 and all of IRELL & 
MANELLA LLP. 

The power appears in the original papers of the prior application. 

□ Since the power does not appear in the original papers, a copy of the power in the prior application is enclosed. 

g] Recognize as associate attorneys: Robert Popa, Reg. No. 43,010; all of Irell & Manella LLP. 

(3 Address all future communications to Rachele Wittwer, IRELL & MANELLA LLP, 1800 Avenue of the 
Stars, Suite 900, Los Angeles, CA 90067 (Telephone: 310-277-1010; Facsimile: 310-203-7199). 
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9. AMENDMENT 

□ For the purpose of reducing the filing fee per MPEP 506 and 607, please enter the following claim cancellations 
before calculating the filing fee (do not cancel all claims) FIRST PRELIMINARY AMENDMENT: 



£3 Preliminary amendent attached. (Please enter after assigned Serial No.) 
10. FEE CALCULATION 

THE FOLLOWING FILING FEE IS BASED ON CLAIMS 
REMAINING AFTER ENTRY OF PRELIMINARY AMENDMENT 
PER MPEP § 506 AND § 607 

Basic Filing Fee $690.00 

Total Effective Claims 129 - 20 = 109 x $18.00 1962.00 
Independent Claims _2_ - 3 = _0_ x $78.00 0 
If Small Entity claim is present, enter one-half (Vi) of subtotal and 

subtract 1326<0 o 

Total Filing Fee Enclosed $1326.00 

No additional fees are believed to be due. If an extension of time is required for this paper or later filed papers 
please consider this a petition for the required extension of time. Please charge any required petition fees, and any other 
fees, except for payment of the issue fee, and charge any underpayment or credit any overpayment during the prosecution 
of this application to our Deposit account No. 09-0946 for which purpose a duplicate of this paper is enclosed. 

Respectfully Submitted, 




Registration No. 43,010 

IRELL & MANELLA LLP 
1800 Avenue of the Stars, Suite 900 
Los Angeles, California 90067 
Telephone: (310) 277-1010 
Facsimile: (310) 203-7199 
E-mail: rpopa@irell.com 
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PATENT 

IN THE U NITED STATES PATENT AND TRADEMARK QFFTCTR 

In the U.S. Patent Application of: 
Inventor (s): Bernard et al . 
Serial No. : 

Filed : June 23, 2000 

Examiner : 

Art Unit : 2 711 

For: HIGH-FIDELITY COLOR IMAGES 



PRELIMINARY AMENDMENT 

Assistant Commissioner for Patents 
Washington, D.C. 2 0231 

Sir: 

This Preliminary Amendment is filed concurrent with the 
above -identified continuation application. Preliminary to 
examining the application, please enter the following 
amendments . 

IN THE TITLE 

Please change the title to "REMOTE COLOR CHARACTERIZATION 
FOR DELIVERY OF HIGH FIDELITY IMAGES . " 
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IN THE SUMMARY OF THE INVFIKFTTOTJ 



Please add the following before Brief Description of the* 
Drawings on page 1 : 

Summary of the Invention 

It is an object of the present invention to 
provide a method for determining the color display 
characteristics of the display of a remote user by 
transferring images to the remote user's display and 
processing information related to the user's 
interaction with the images to determine the color 
display characteristics of the user's display. 

In a further aspect, the present invention 
provides a method for characterizing the monitor of a 
computer connected to a server through a network by 
transferring images from the server to the computer 
monitor and analyzing the interaction of a computer 
user at the server to determine color display 
characteristics of the computer monitor. 

In another aspect the present invention provides 
a characterization program running on a server to 
receive a request for characterizing the monitor of a 
remote client computer. The characterization program 
controls the transfer of images to the client computer 
monitor and analyzes information generated by a client 
user's interaction with the images to determine the 
color display characteristics of the monitor. 

In a still further aspect, the characterization 
program selects images for transfer to the client 
computer monitor based upon feedback related to the 
user's interaction with the images. The images may 
further be selected based on parameters such as 
desired level of thoroughness of characterization, 
known hardware characteristics of the user, known 
software characteristics of the user, known 
characteristics of the network connection to the user, 
or characteristics of the images transferred to the 
user . 



IN THE CLAIMS 

Please cancel original claims 1-7, and substitute the 
following claims for examination: 
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1. A method for determining color display characteristics of a 
remote user's display, comprising the steps of: 

transferring images to the remote user's display upon 
initiation of color display characterization; and 

processing information related to the user's interactions 
with the images to determine color display characteristics of 
the remote user's display. 

2. The method of claim 1, wherein the step of transferring 
images to the remote user's display upon initiation of color 
display characterization further comprises the step of: 

transferring the images to the remote user's display before 
transferring information processing code to the remote user. 

3. The method of claim 1, wherein the step of processing 
information related to the user's interactions with the images 
to determine color display characteristics of the remote user's 
display further comprises the step of: 

processing the information at a server to determine color 
display characteristics of the remote user's display. 

4. The method of claim 1, wherein the step of transferring 
images to a remote user's display further comprises the step of: 

transferring the images to the remote user's display from a 
server . 



5. The method of claim 4, wherein the step of processing 
information related to the user's interactions with the images 
to determine color display characteristics of the remote user's 
display further comprises the step of: 

processing the information at the server to determine color 
display characteristics of the remote user's display. 

6. The method of claims 2, 3 or 4, wherein: 

the remote user is a client computer connected to a 
network. 

7. The method of claim 6, wherein the user's display is a 
monitor, a projector, a printer, or a plotter. 

8. The method of claim 1, wherein the images comprise test 
images or test patterns. 

9. The method of claim 6, wherein the step of transferring 
images to the remote user's display further comprises the step 
of : 
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selecting the images based on parameters including desired 
level of thoroughness of characterization, known hardware 
characteristics of the user, known software characteristics of 
the user, known characteristics of the network connection to the 
user, or characteristics of the images transferred to the user. 

10. The method of claim 9, wherein the step of selecting the 
images based on parameters further comprises the step of: 

selecting test images or test patterns based on the 
parameters . 

11. The method of claim 10, wherein the step of selecting test 
images or test patterns based on the parameters further 
comprises the step of: 

selecting the order in which the test images or test 
patterns are transferred to the user's display based on the 
parameters . 

12. The method of claim 5, wherein the step of processing the 
information at the server to determine color display 
characteristics of the remote user's display further comprises 
the step of: 

transferring to the server information related to image 
selection by the user in response to the images transferred by 
the server to the user's display. 

13. The method of claim 12, wherein the step of transferring to 
the server information related to image selection by the user in 
response to the images transferred by the server to the user's 
display further comprises the step of: 

transferring information indicative of test images or test 
patterns selected by the user from among alternative test images 
or test patterns, respectively, transferred by the server. 

14. The method of claim 13, wherein the test images or test 
patterns selected by the user are selected by a person viewing 
the user's display. 

15. The method of claim 13, wherein the test images or test 
patterns selected by the user are selected by a user calibrator. 

16. The method of claim 15, wherein the user calibrator further 
comprises : 

executable code running on a client computer connected to 
the server through a network to receive the images from the 
server and display the images on the user's display. 
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17. The method of claim 13, wherein the step of transferring 
images to the remote user's display further comprises the step 
of: 

selecting the images based on the information indicative of 
test images or test patterns selected by the user. 

18. The method of claim 17, wherein the step of selecting the 
images based on the information indicative of test images or 
test patterns selected by the user transferred to the server 
further comprises the step of: 

selecting the order in which the images are transferred to 
the user's display. 

19. The method of claim 5, further comprising the step of: 
initiating color display characterization of the remote 

user's display in response to a request to the server. 

20. The method of claim 19, wherein the step of initiating 
color display characterization of the remote user's display in 
response to a request to the server further comprises the step 
of: 

initiating color display characterization of the remote 
user's display in response to a request from the remote user to 
the server. 

21. The method of claim 19, wherein the request from the remote 
user to the server further comprises : 

an indication of the remote user's desired level of 
thoroughness of characterization. 

22. The method of claim 5, wherein the step of processing the 
information at the server to determine color display 
characteristics of the remote user's display further comprises 
the step of : 

creating a user's display characterization file comprising 
the color display characteristics of the user's display. 

23. The method of claim 22, wherein the step of processing the 
information at the server to determine color display 
characteristics of the remote user's display further comprises 
the step of: 

providing an algorithm at the server to analyze the 
information to determine the color display characteristics of 
the user's display. 

24. The method of claim 23, wherein the algorithm further 
comprises : 



305529.01 03 



-5- 



154025-0056 



executable code running on a server computer to execute the 
algorithm. 

25. The method of claim 22, comprising the further step of: 
providing the characterization file to the user. 

26. The method of claim 22, comprising the further step of: 
providing the characterization file to an image provider. 

27. The method of claim 22, wherein: 
the image provider is the server. 

28. The method of claims 25 or 26, comprising the further step 
of : 

adjusting images distributed by the image provider to the 
user in accordance with the characterization file. 

29. The method of claim 28, wherein the step of adjusting 
images in accordance with the characterization file further 
comprises the step of: 

color correcting the images in accordance with the 
characterization file. 

30. The method of claim 5, wherein the step of transferring 
images to the remote user's display from a server further 
comprises the step of: 

providing a characterization program on the server to 
transfer images to the user's display. 

31. The method of claim 30, wherein the characterization 
program further comprises: 

executable code running on a server computer connected to a 
network to transfer images to the user's display. 

32. The method of claim 30, wherein the step of providing a 
characterization program further comprises the step of: 

providing a characterization program to select the images 
based on parameters including desired level of thoroughness of 
characterization, known hardware characteristics of the user, 
known software characteristics of the user, known 
characteristics of the connection to the user, or 
characteristics of the images provided to the user. 

33. The method of claim 32, wherein the step of providing a 
characterization program further comprises the step of: 
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providing a characterization program to select the order in 
which the images are provided to the user for display on the 
user's display based on the parameters. 

34. The method of claim 30, wherein the step of providing a 
characterization program further comprises the step of: 

providing a characterization program to receive information 
from the user related to image selection by the user in response 
to the images transferred to the user's display. 

35. The method of claim 34, wherein the step of providing a 
characterization program further comprises the step of: 

providing a characterization program to transfer images to 
the user's display based on the selection information received 
from the user. 

36. The method of claim 30, wherein the step of providing a 
characterization program further comprises the step of: 

providing a characterization program to create a user's 
display characterization file comprising the color display 
characteristics of the user's display. 

37. The method of claim 36, wherein the step of providing a 
characterization program to create a user's display 
characterization file further comprises the step of: 

providing a characterization program including an algorithm 
to analyze the selection information received from the user to 
determine the color display characteristics of the user's 
display. 

38. A system for determining color display characteristics of a 
remote user's display, comprising: 

an agent to transfer images to the remote user's display 
upon initiation of color display characterization; and 

an analyzer to process information related to the user's 
interactions with the images to determine color display 
characteristics of the remote user's display. 

39. The system of claim 38, wherein the agent further 
comprises : 

an agent to transfer the images to the remote user's 
display before transferring information processing code to the 
remote user. 

40. The system of claim 38, further comprising: 
a server to host the agent . 
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41. The system of claim 38, further comprising: 
a server to host the analyzer. 

42. The system of claim 38, further comprising: 

a server to host the agent and to host the analyzer. 

43. The system of claims 40, 41 or 42, wherein the remote user 
further comprises: 

a client computer connected to the server through a 
network. 

44. The system of claim 43, wherein the user's display further 
comprises : 

a monitor, a projector, a printer, or a plotter. 

45. The system of claim 38, wherein the images comprise test 
images or test patterns. 

46. The system of claim 43, wherein the agent further 
comprises : 

an agent to select the images based on parameters including 
desired level of thoroughness of characterization, known 
hardware characteristics of the user, known software 
characteristics of the user, known characteristics of the 
network connection to the user, or characteristics of the images 
transferred to the user. 

47. The system of claim 46, wherein the agent further 
comprises : 

an agent to select test images or test patterns based on 
the parameters. 

48. The system of claim 47, wherein the agent further 
comprises : 

an agent to select the order in which the test images or 
test patterns are transferred to the user's display based on the 
parameters . 

49. The system of claim 43, wherein the analyzer further 
comprises : 

an analyzer to receive information related to image 
selection by the user in response to the images transferred to 
the user's display. 

50. The system of claim 49, wherein the analyzer further 
comprises : 
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an analyzer to receive information indicative of test 
images or test patterns selected by the user from among 
alternative test images or test patterns, respectively, 
transferred to the user by the agent. 

51. The system of claim 50, wherein the test images or test 
patterns selected by the user are selected by a person viewing 
the user's display. 

52. The system of claim 50, wherein the user further comprises 
a calibrator to select from among the alternative test 

images or test patterns. 

53. The system of claim 52, wherein the calibrator further 
comprises : 

executable code running on the client computer. 

54. The system of claim 50, wherein the agent further 
comprises : 

an agent to select the images based on the information 
indicative of test images or test patterns selected by the user 

55. The system of claim 54, wherein the agent further 
comprises : 

an agent to select the order in which the images are 
transferred to the user's display. 

56. The system of claim 43, wherein the agent further 
comprises : 

an agent to initiate color display characterization of the 
remote user's display in response to a request to the server. 

57. The system of claim 56, wherein the agent further 
comprises : 

an agent to initiate color display characterization of the 
remote user's display in response to a request from the remote 
user to the server. 

58. The system of claim 56, wherein the agent further 
comprises : 

an agent to receive an indication of the remote user's 
desired level of thoroughness of characterization. 

59. The system of claim 43, wherein the analyzer further 
comprises : 
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an analyzer to create a user's display characterization 
file comprising the color display characteristics of the user's 
display. 

60. The system of claim 59, wherein the analyzer further 
comprises : 

an algorithm to analyze the information to determine the 
color display characteristics of the user's display. 

61. The system of claim 60, wherein the algorithm further 
comprises : 

executable code running on a server computer to execute the 
algorithm. 

62. The system of claim 43, wherein the agent further 
comprises : 

a characterization program on the server to transfer images 
to the user's display. 

63. The system of claim 62, wherein the characterization 
program further comprises: 

executable code running on a server computer connected to a 
network to transfer images to the user's display. 

64. The system of claim 62, wherein the agent further 
comprises : 

a characterization program to select the images based on 
parameters including desired level of thoroughness of 
characterization, known hardware characteristics of the user, 
known software characteristics of the user, known 
characteristics of the connection to the user, or 
characteristics of the images provided to the user. 

65. The system of claim 64, wherein the characterization 
program further comprises: 

a characterization program to select the order in which the 
images are provided to the user for display on the user's 
display based on the parameters. 

66. The system of claim 62, wherein the characterization 
program further comprises: 

a characterization program to receive information from the 
user related to image selection by the user in response to the 
images transferred to the user's display. 

67. The system of claim 66, wherein the characterization 
program further comprises: 
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a characterization program to transfer images to the user's 
display based on the selection information received from the 
user. 

68. The system of claim 62, wherein the characterization 
program further comprises: 

a characterization program to create a user's display 
characterization file comprising the color display 
characteristics of the user's display. 

69. The system of claim 68, wherein the characterization 
program further comprises : 

an algorithm to analyze the selection information received 
from the user to determine the color display characteristics of 
the user's display. 



This is a continuation application of serial no. 09/439,482 
filed on November 12, 1999. No new matter has been introduced 
by this preliminary amendment. All claims presented herein are 
directed to the originally disclosed invention, and early 
consideration and allowance are earnestly solicited. 



REMARKS 



Respectfully Submitted, 



Dated: June 2 3, 2000 




Robert Popa 
Reg. No. 43,010 



IRELL & MANELLA LLP 

1800 Avenue of the Stars 
Suite 900 

Los Angeles, CA 90067-4276 
Telephone: (310) 2 77-1010 
Facsimile: (310) 203-7535 
E-mail : rpopa@irell . com 



305529.01 03 



-11- 



154025-0016 



EXPRESS MAIL LABEL NO. EL088712 670US 
Date of Deposit: 11/12/99 

5 

HIGH FIDELITY COLOR IMAGES 



Related Applications 

10 This application is a continuation-in-part of 

copending Unites States patent application serial no. 
(unassigned) filed 10/19/99 and claims the priority of 
provisional applications serial no. 60/108 , 444 filed 
11/13/98, serial no. 60/108,442 filed 11/13/98, and serial 

15 no. 60/108,229 filed 11/13/98. 

Background of the Invention 

1. Field of the Invention: 

This invention relates to image display over a 
2 0 network, and more specifically to improved image color 
display over a network. 

Brief Description of the Drawings 

25 Fig. 1 is a stylized block diagram of a network according 
to the present invention. 

Fig. 2 is a flow chart of the process of the present 
invention. 
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Fig. 3A is block diagram of a network according to the 
present invention . 

Fig, 3B is a flow chart of the process of the present 
invention . 

5 Fig. 4 is block diagram of a network according to the 
present invention . 

Fig. 5A is a flow chart of the process of the present 
invention. 

Fig. 5B is block diagram of a network according to the 
10 present invention. 

Fig. 6A is a screen view of a web page according to the 
present invention . 

Fig. 6B is block diagram of an HTML file according to the 
present invention . 

15 Fig. 7 is a block diagram of the process steps of the 
present invention. 

Fig. 8 is a block diagram of the process steps of the 
present invention . 

Fig. 9A is an enlarged view of an indicator according to 
20 the present invention. 

Fig. 9B is an enlarged view of an alternate indicator 
according to the present invention. 

Fig. 10 is a block diagram of an alternate embodiment 
according to the present invention. 
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Fig. 11 is a block diagram of an alternate network 
according to the present invention. 

Fig. 12 is graph of a parameter space according to the 
present invention. 

5 Fig. 13 is a parameter distribution curve according to the 
present invention . 

Fig. 14 is a graph of display transfer functions according 
to the present invention. 

Fig. 15 is a block diagram of a first alternate process 
10 according to the present invention. 

Fig. 16 is a block diagram of a second alternate process 
according to the present invention. 

Fig. 17 is a detailed block diagram of a network according 
to the present invention. 

15 Fig. 18 is a detailed transform curve according to the 
present invention . 

Fig. 19 is a detailed diagram of a display screen according 
to the present invention. 

2 0 The features and advantages of this invention will 

become apparent from the detailed description and 
accompanying figures that follow. In the figures and 
description, numerals indicate the various features of the 
invention/ like numerals referring to like features 

25 throughout both the drawings and the description. 
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Detailed Description of the Preferred Embodiment (s) 

Referring now to Fig. 1, system 10 according to the 
present invention provides color images from network 
5 servers to users enhanced when possible with user specific 
color correction information to provide high fidelity color 
images to the users. In particular, in accordance with a 
preferred embodiment of the present invention, color server 
2 0 may provide color catalog pages for clothing or other 
10 products to a potential buyer, such as user 12, adjusted to 
provide high fidelity color images in accordance with the 
color display characteristics of display 22. 

In general, system 10 may include one or more network 
15 servers and one or more users. Network servers may include 

color server 20, commercial server 18, and server 76. 

Users may include users 12, 14 and 16, interconnected to 

network servers using network 13. Network nodes such as 

color server 2 0 may serve as a user or client for some 
20 purposes and a server for others. System 10 does not 

require a static server, constantly functioning as a 

server, in all embodiments. 

Network 13 may be any type of network such as a LAN, 

intranet or an internet such as the World Wide Web (WWW) . 
25 Network 13 may also utilize any type of appropriate network 

protocol, such as HTTP as used on the World Wide Web. 

Color server 20 may be used to host color correctable 

images 50 to be made available to users of commercial or 

other network sites. 
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User 12 may be any conventional network client device 
and may include one or more electronic devices 24, 
conventionally a personal computer or workstation, and one 
or more display devices 22, conventionally a CRT or LCD 
5 display monitor. User 12 may also include remote storage 
26 and or local storage 28 within electronic device 24. 
Remote storage 26 may also be available to electronic 
device 24 through network 13. User 12 may also include one 
or more output devices 3 0 which may be any type of printer, 

10 recorder or plotter. User 12 may also include one or more 
input devices 3 2 which may be any type of scanner, reader, 
image capture device or other data transfer device. 

Delivery of accurate images according to the present 
invention begins with image request 54 sent to commercial 

15 server 18 for the display of an image on monitor 22. Image 
request 54 may originate with user 12 or any network device 
such as server 76. Image request 54 may be an individual 
request for a specific image, graphic, drawing, rendering 
or similar data file or it may be part of a larger data 

20 request such as a web page request. Commercial server 18 
may respond to image request 54 by then inquiring of the 
source of the image request to determine if display 
calibration or characterization data 38 for display 22 is 
available . 

25 If display calibration or characterization data 38 is 

available to commercial server 18, a color corrected 
version of image 52 may be provided to user 12 in 
accordance with data 38. Thus, image 52 as then displayed 
on display 22 may be a more accurate color representation 

30 of a reference or author image, image 56. than may otherwise 
be achieved. Concurrent with delivery of color, corrected 
images, display 22 may present a visual or other indicator 
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58, indicating that the image or images being viewed are 
color corrected and accurate. Indicator 58, or a variation 
thereof, may also be used to indicate when images are not 
color corrected and or provide other information to user 
5 12 . An online shopper or other user may have increased 
confidence to make purchases, as a result of viewing image 
52 over network 13, knowing the color of image 52 as 
actually viewed is accurate. 

If display calibration or characterization data 38 is 

10 not available to commercial server 18, user 12 may be 

invited to calibrate or characterize display 22 through 
network 13 with or without requiring plug- ins or 
downloads. Without display calibration or 
characterization, image 52 may appear differently to users 

15 12, 14 and 16 because of different operating systems, video 
cards, monitor settings and a range of other factors. 

According to the present invention, process 131 as 
discussed below may be a one-time process, involving four 
images such as images 62-65 and nine user interactions that 

20 may be mouse clicks, key presses, screen contacts or other 
interactive inputs to electronic device 24 . Process 131 
may include other combinations or techniques to 
characterize a display system or capture other 
personalization data. Process 131 may generally require 1 

25 to 2 minutes to complete, some circumstances may require 
more time. After completion of process 131, user 12 may 
receive color corrected images without further setup. 
Discussions throughout that refer to color correction 
should be understood to apply equally to gray scale 

3 0 correction. A characterizable and correctable network 

system according to the present invention may also be used 
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to control delivery and ensure the accuracy of sounds, 
smells, tastes and textures. 

Data Block Sharing 

Referring again to Fig. 1, calibration or 
5 characterization data 38 must be made available across 

multiple network domains for convenient use to correct and 
distribute images 40 or 42 across network 13. Some network 
protocols such as the HTTP protocol used on the WWW are 
able to store data blocks on user 12 or other network 

10 devices. Data block 34 may include many different types of 
information such as user preferences and user hardware 
characteristics. Conventional techniques providing client - 
resident data block storage are often referred to as 
providing "Cookies" . 

15 Cookie 36 may include one or more blocks of 

information passed from a server and stored on a user, 
often as a result of the collection of that information by 
the server from the user. Cookie 3 6 may then be used to 
provide, or retrieve, information from a user to a server. 

2 0 For example, user 12 information concerning domain 77 may 
be passed from server 76 to user 12 and stored on user 12 
as cookie 66\ Subsequent connection of user 12 to server 
76 would prompt server 76 to request cookie 66 to remind 
server 76 of information about user 12. This technique is 

25 conventionally used to provide personalized settings or 
information specific to user 12 on server 76 without 
requiring server 76 to store the data information for all 
its users. For security purposes, conventional cookies are 
designed so that they cannot be shared across multiple 

30 domains. Conventional cookies may even be limited to URL 
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ranges within a domain, as is the case with the HTTP 
protocol. In a conventional network, a server in a first 
domain cannot access cookies stored for another domain. 

Conventional cookies may not therefor be useful for 
5 providing display characterization and or calibration 

information about a user to a server unless the cookies are 
specific to that server, that is, unless the server has 
placed the cookies on the user. In accordance with the 
present invention however, various techniques of server and 

10 user redirection may be used to achieve results equivalent 
to sharing cookies across domains. 

For example, if user 12 initiates' request 60 to server 
76, server 76 may request data block 34 from user 12 to 
process request 60. Data block 34 may include personal, 

15 preference, calibration and or characterization information 
related to user 12. Data block 34 may also include an 
index to a database such as database 4 6 permitting 
information 45 to be retrieved from database 46. 

Referring now to Fig. 2, a method of sharing data 

20 blocks according to a first embodiment of the present 

invention begins at step 90 with request 54 from a user 12. 
According to the present invention, users 12, 14 and 16 may 
exist in one of three conditions. Standard condition 89S, 
in which no characterization and or calibration has been 

25 performed, Correction Enabled condition 89C, in which 
characterization and or calibration has been performed 
according to the present invention, Modified condition 89M, 
in which characterization and or calibration has been 
performed not according to the present invention. 

30 At step 91, agent 41 checks user 12 for a cookie 66. 

At step 92 agent 41 determines if a cookie has been 
received. If no cookie is received, user 12 is bounced to 



212546 



8 



154025-0016 



color server 20 at step 93. Bouncing may be accomplished 
using Java script or it may be accomplished using HTTP 
redirect. A currently preferred embodiment of the present 
invention uses Java script. 
5 If agent 41 receives cookie 66 from user 12, agent 41 

and commercial server 18 have enough information to provide 
user 12 with color corrected information at step 99A as 
requested in image request 54. 

At step 94 color server 20 checks user 12 for a domain 
10 15 cookie. If no domain 15 cookie is present, user 12 is 
given unique identifier ID and is bounced to color server 
20 at step 95. The existence of unique identifier ID 
signifies to agent 41 that user 12 is not characterized and 
or calibrated, and that corrected images may not be 
15 prepared for user 12 using existing information. 

At step 96, if color server 20 detects a domain 15 
cookie 66A in user 12, user 12 is bounced to commercial 
server 18 along with display calibration or 
characterization data 38. 
20 At step 97 agent 41 drops cookie 66C to user 12. 

Agent 41 uses the contents of cookie 66c to provide a 
corrected image 52 to user 12 at step 98. 

Referring again to Fig. 2, a method of sharing data 
blocks according to a second embodiment of the present 
25 invention begins at step 90 with request 54 from a user 12. 

At step 91, agent 41 checks user 12 for a cookie 66. 

At step 92 agent 41 determines if a cookie has been 
received. If no, user 12 is bounced to color server 20 at 
step 93. 

30 If agent 41 receives cookie 66 from user 12, agent 41 

and commercial server 18 have enough information to provide 
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user 12 with color corrected information at step 99A as 
requested in image request 54 . 

At step 94Q user 12 is bounced to commercial server 18 
along with domain 19 cookie 66Q. At step 95Q image request 
5 54 is resent. At step 96Q, agent 41 detects domain 19 
cookie 66Q. Commercial server 18 may use 66Q and image 
file 52F to provide user 12 with color corrected 
information at step 99Q as requested in image request 54 
Referring again to Fig. 2, a method of sharing data 
10 blocks according to a third embodiment of the present 

invention begins at step 90 with request 54 from user 12. 
At step 91, agent 41 checks user 12 for a cookie 66. 
At step 92 agent 41 determines if cookie 6 6 or 
information 921 has been received. If cookie 66 is not 
15 present and information 921 is present, agent 41 becomes a 
user and requests characterization and or calibration 
information for user 12 from color server 20. Information 
921 must be enough information to permit to color server 2 0 
to recognize user 12 as the beneficiary of the surrogate 
20 client action of agent 41. 

If agent 41 receives display calibration or 
characterization data 38 from color server 20, agent 41 
drops cookie 66R to user 12. Using cookie 66R, agent 41 
and commercial server 18 have enough information to provide 
25 user 12 with color corrected information at step 99A as 
requested in image* request 54 . 

Nodes connected to network 13 may include various 
combinations of displays and electronic devices and may 
also include a variety of video hardware 68 and video 
30 software 70, Video hardware 68 may include video cards, 
boards, chips and accelerators. Video software, 70 may 
include drivers, applets and applications. 
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Display calibration and or characterization data 38 
does not exist for user 14 in standard condition. Thus, 
user 14 may not receive color corrected images according to 
the present invention. Request 54 from user 14, requesting 
5 image file 52F from commercial server 18 will cause agent 
41 to initiate examination 82. Examination 82 may be a 
request for a cookie or calibration and or characterization 
data, and will not yield any calibration and or 
characterization data of any form from user 14. Agent 41 

10 may be implemented as a software filter, an application or 
any other suitable technique. 

User 14 has no calibration and or characterization 
data to return to commercial server 18. Upon receiving no 
calibration and or characterization data in response to 

15 examination 82, agent 41 may transmit response 43 to user 
14. Response 43 may cause user 14 to transmit request 31 
to color server 20. Server 20 has no calibration and or 
characterization data to return and may transmit response 
33 to user 14. Response 33 may include a unique identifier 

20 ID to identify user 14 and cause commercial server 18 to 

drop a cookie 66E to user 14 . Cookie 66E may be considered 
an empty cookie, it contains only unique identifier ID and 
will not allow commercial server 18 to produce corrected 
images to user 14. 

25 Alternatively, missing, inadequate, corrupted or 

otherwise unusable calibration and or characterization data 
from color server 20 may initiate inquiry 35 from color 
server 20 to user 14. Inquiry 35 may be an invitation or 
other initiation to user 14 to engage in remote or local 

30 calibration and or characterization. If user 14 declines 
to calibrate or characterize, image 52 displayed by user 14 
would be uncorrected. 
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User 12 may be calibrated and or characterized locally 
or remotely. Local calibration and or characterization is 
discussed in U.S. Patent No. 5,638,117 to Engeldrum & 
Hilliard . Remote calibration and or characterization is 
5 discussed in more detail below. After calibration and or 
characterization according to the present invention, 
display calibration or characterization data 38 may be 
stored locally on local storage 28 of user 12 or stored 
remotely in database 46 on color server 20 or as data file 

10 72. Calibration and or characterization data 38 may be 

stored as a block of data such as cookie 66 or some similar 
method using other network protocols. 

Request 54 from user 12, requesting image file 52F 
from commercial server 18 will cause agent 41 to initiate 

15 examination 82. Examination 82 may initiate return of 
cookie 66 to commercial server 18 if cookie 66 was 
initially generated by an element within domain 19. 
Examination 82 may also initiate return of display 
calibration or characterization data 38 to commercial 

20 server 18. Return of either cookie 66 or display 
calibration or characterization data 38 may permit 
commercial server 18 to correct image file 52F for display 
on display 22 as image 52. 

If cookie 66 was deposited by a foreign domain and is 

25 inaccessible, or display calibration or characterization 
data 38 is missing or inaccessible, examination 82 may 
return no data. Upon receiving no calibration and or 
characterization data in response to examination 82, agent 
41 may transmit response 43 to user 12. Response 43 may 

3 0 cause user 12 to transmit request 31 to color' server 20. 

Request 31 may Color server 2 0 may transmit response 37 to 
user 12 which causes user 12 to transmit data 21 to 
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commercial server 18. Data 21 may contain display 
calibration or characterization data 38 and or other user 
profile information. 

In modified condition, user 16 may have been 
5 calibrated and or characterized locally or remotely to 

generate a foreign calibration and or characterization file 
74. Foreign calibration or characterization data 74 may be 
stored locally in electronic device 78 or stored remotely. 
Calibrat ion and or characterization data 74 may be stored 

10 as a block of data such as cookie 80 or some similar method 
using other network protocols. Agent 41 may detect foreign 
calibration and or characterization file 74 or cookie 80. 
Upon detection of cookie 80 or foreign calibration and or 
characterization file 74 agent 41 may translate the foreign 

15 files to translated data 84 to enable correction of images 
according to the present invention. Alternatively, agent 
41 may also bounce user 16 to color server 20 along with 
translated data 84 to enable color server 20 to drop 
translated data cookie 86 onto user 16, Translation of 

20 foreign calibration and or characterization file 74 or 
cookie 80 may also be accomplished by color server 20. 

The above process may be repeated as many times as 
necessary in order to satisfy requests made of a server by 
a client. 

2 5 The domains enumerated above need not be distinct from 

each other. For example, a domain that has a cookie it 
wishes to share and the domain that distributes the cookie 
could be the same domain. Likewise, the domain that has a 
cookie to share, the domain that distributes the cookie, 

30 and the domain that requests the cookie could all be the 
same domain as well, data block sharing according to the 
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present invention might be required if a domain and its 
cookies are partitioned by URL ranges. 

The act of sending the client from one domain to 
another in order to retrieve information may be done using 
any of a multiplicity of methods including the use of a 
page description language such as HTML or XML, by using 
some scripting language such as JavaScript or VBScript, or 
by some combination of the above. For example, HTML tables 
using HTTP POST or HTTP GET commands can be used in 
conjunction with JavaScript or VBScript to automate inter- 
page, and thus inter-domain, transfers. 

Methods of supplying the information returned by a 
cookie sharing server may include, but are not limited to, 
responses to forms, additional URL header fields, or 
additional cookies in a URL's domain. 

Remote Characterization 

Referring now to Fig. 3A, a user of a, local computer 
100 may desire characterization and or calibration of one 
or more input/output devices such as display 102, scanner 
104, other image input device 106, printer 108, plotter 
110, or other image output device 112. Computer 100 may be 
connected via a wired or wireless network such as network 
114 or directly via modem or cable or other means to a 
remote server 116 where software 118 and data 120 needed 
for characterization may be stored. 

After link 122 is established between a Remote Server 
116 and computer 100, either server 116 or computer 100 may 
request characterization and or calibration service from a 
remote server on behalf of computer 100. Server 116 may 
then initiate a characterization program 124. 
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Characterization program 124 may send one or more 
characterization images 126 or test patterns to computer 
100 and its associated devices 102, 104, 106, 108, 110, and 
112. If the device to be characterized is an output device 
5 such as display 102, printer 108, plotter 110 or image 

output device 112, characterization or test image 126 may 
be presented to a user or a local calibration mechanism 128 
using computer 100 's manner of output onto the selected 
device . 

10 If the device to be characterized is scanner 104, 

image capture device 105 or other image input device 106, 
characterization or test image 126 may be presented to the 
user or local calibration mechanism 128 using a 
conventional input from the device to be characterized and 

15 a conventional output onto display 102 or any other device. 

Referring now to Fig. 3B, a process 131, of remotely 
characterizing display 102 according to the present 
invention begins at step 130 with a request 125 for 
characterization that may be initiated by computer 100 or 

20 server 116. At step 132, based upon request 125, server 
116 initiates characterization program 124. At step 134, 
characterization program 124 through server 116 transmits a 
test pattern or image such as image 126 which may then be 
presented to the user or local calibration mechanism 128 on 

25 the device to be characterized such as display 102. At 
step 136 a user or local calibration mechanism such as 
calibrator 128 may make one or more choices based on the 
image or test pattern as it appears on the device to be 
characterized such as display 102. Choices made by a user 

30 may be made in any conventional manner as through keyboard 
or mouse entry or any tactile feedback device such as a 
touchscreen, a user may also indicate their preferences in 
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other ways such as verbally. At step 138 the choice or 
choices may result in quantifiable data such as choice data 
15 0 that may be captured locally and or communicated back 
to characterization program 124 on server 116 for capture. 
5 One of the choices to be made by a user may be to 

select a level of thoroughness of the characterization and 
or calibration. Characterization program 124 may provide 
one or more options for device characterization such as a 
full or partial characterization, or multiple levels of 

10 characterization complexity. At step 140 characterization 
program 124 determines if a sufficient number of images or 
test patterns have been sent to computer 100, and if a 
sufficient number of responses have been captured to 
complete the level of characterization desired. In another 

15 aspect of the present invention characterization program 
124 may also evaluate choice data 150 to determine if 
sufficient data has been received to adequately 
characterize computer 100 at the desired level. If 
insufficient data such as choice data 150 has been captured 

20 characterization program 124 may repeat process 131 from 
step 134 until sufficient choice data has been captured. 

After choice data 150 has been transmitted to server 
116, choice data 150 may be used by an electronic algorithm 
such as characterization program 124 to create a 

25 characterization file such as characterization file 152 

about the device to be characterized such as computer 10 0 
or display 102, 

Characterization file 152 might be used for one or 
more of the following applications: 

30 send characterization file 152 to computer 100 for 

local usage such as but not limited to providing operating 
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system 101 of computer 100 with information about the color 
capabilities of computer 100 and/or 

subsequently use characterization information such as 
characterization file 152 for modifying or otherwise 
controlling the flow of images such as still image 154 or 
streaming images 156 for display, output or other use by 
computer 100 based on the contents of characterization file 
152 and/or 

store characterization information such as 
characterization file 152 locally on a network node such as 
server 116 or other computers connected to server 116 
and/or 

send characterization information such as 
characterization file 152 to a third location such as 
server 158, and/or 

feed into creation or alteration of the test patterns, 
images, or other calibration and characterization implement 
such as image 12 6 and/or 

otherwise provide characterization information such as 
characterization file 152 for use by another program such 
as software 118 or location such as server 158 in providing 
images or other services to computer 100. 

REMOTE CHARACTERIZATION 

Referring now to Fig. 4, in another aspect, the 
present invention may include a combination of client 
software 160 and server software 162 connected using 
through a network such as network 164 and using network 
protocols such as Internet protocols 166. It is- expected 
that many individual local computers such as computer 168 
may from time to time connect to any of a number of remote 
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servers such as server 170 over a network such as network 
164 which may be the Internet. At a local computer such as 
computer 168 with the device to be characterized such as 
display 172, a user may initiate a request such as request 
5 174 to a remote server such as server 170. Server 170 may 
incorporate images, data, test patterns, and/or logic 
embodied in a characterization program such as program 176 
onto an appropriate hardware platform 178. A 
characterization program such as program 176 may do one or 

10 more of the following (a) manage communication link 180 
with computer 168, (b) select one or more appropriate 
characterization images and or test patterns or other test 
data such as image 182 to be sent to the device to be 
calibrated, the selection of appropriate test images may be 

15 determined by the level of complexity of characterization 
desired, by the hardware to be characterized, by the 
characteristics of the connection, or by characteristics of 
images to be displayed, (c) create, change or alter 
existing calibration images or test pattern to send and/or 

20 change the order thereof if required, (d) send one or more 
calibration images and or test patterns, (e) collect 
characterization and or calibration data such as choice 
data 184 returned from computer 168, (f) create 
characterization information such as characterization file 

25 186 from analysis of the images or test patterns such as 
image 182 sent and from the responses such as choice data 
184 received, (g) store characterization file 186 on server 
170 and/or connected machines such as server 171, (h) use 
characterization file 186 to modify images such as image 

3 0 190 or to change the flow of unmodified image's such as 
images 192 sent to computer 168 (i) transmit 
characterization file 186 to other sites such as site 194 
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for use at those sites to provide services such as data 
196, which may include programs, data and or images, to 
computer 168 or other purposes and/or (j) transmit 
characterization file 186 to computer 168 for local usage. 
5 For example, the present invention might be used as a 

technique to characterize client monitors over the Internet 
and to use the characterization information to color 
correct images sent to that client so as to provide 
accurate color display over the Internet. 

10 Correction Notification 

In another aspect of the present invention, a user or 
client such as computer 168 may be provided with feedback 
such as icon 173 over network 164 as to the color 
correction status of imagery on a client display, thus 

15 notifying the user that the color image or images such as 
images 192 being viewed are color accurate. This 
information is critical since the end user, is often in a 
remote location, separated in time and distance from the 
author of the image or images, and unable to know the 

20 characteristics of the image or images being viewed. In 

particular, the present invention may automatically inform 
viewers and/or other receivers of digital images as to the 
state of color correction for the digital images, thus 
notifying a viewer of the visual integrity of the digital 

25 image being displayed. Consequently, viewers may feel 
assured and secure about images they see as to the color 
accuracy of those images. 

In particular, the present invention may be 
implemented as a software process that may be a stand alone 

30 application or it may be loaded into either an Internet 
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browser or server technology. A browser is a client 
application that enables a user to view HTML (or 
equivalent) documents on the web, another network, or the 
user's computer. The software may be implemented in the 
5 form of a small program or an applet, such as Java or 
ActiveX application programs, that is loaded into a web 
browser, such as Microsoft's Internet Explorer or 
Netscape's Navigator. The software may also be implemented 
on server technology, such as Cosmo Color from Silicon 

10 Graphics. One skilled in the art will recognize that other 
conventional or newly developed software processes may be 
used as well and the invention may be implemented using 
hardware or a combination of hardware and software. One 
skilled in the art will recognize that the invention can 

15 apply to other browser technology, such as local CD 
browsers and other non- Internet browsers. 

Referring to Fig.'s 5A and 5B, a flowchart of process 
240 for implementing the present invention through a sample 
network 242 is illustrated. For example, using Internet 

20 protocols, the present invention is typically enabled when 
browser 244 begins to reassemble web page 246 on display 
248, following the hidden HTML codes or other protocols in 
a requested document such as web page 246 to determine 
where to place one or more elements such as element 252 

2 5 which may be text, images, graphics or videos onscreen. In 

particular, an algorithm according to the present invention 
such as algorithm 256 may be implemented when browser 244 
begins to assemble an image part of a requested page such 
as element 252. One skilled in the art, however, will 

3 0 recognize that implementation of the present invention can 

be initiated at anytime a page element requiring accurate 
color or gray scale such as a graphic, image or video is 
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present. ^ Color or gray scale accuracy is identified here 
as high fidelity or identical rendition of a page element 
as compared to the image of the page element as viewed on 
the authoring display. 
. 5 The technique according to the present invention 

initially determines whether the image has been color 
enabled as shown at step 241 and subsequently whether a 
user such as client 250 has been color characterized or 
corrected as shown at step 243, To detect whether an image 
10 is color enabled according to the present invention, an 
algorithm such as algorithm 256 may detect whether color 
correction information such as color specific files 258 or 
registry entries 260 are associated with a page element 
such as element 252. Color correction information may also 
.15 include: (1) user specific Hypertext Markup Language (HTML) 
tags within the web page that designate the color 
properties of the source image such as tags 262, (2) 
standard ICC profiles such as profile 264 which may be 
embedded within the image file itself and (3) pointers to 
20 user specific (i.e. HTML) or standard (i.e. ICC profiles) 
color files associated with the image file such as color 
specific files 258. At step 245, algorithm 256 may 
determine whether network 242 is acting in accordance with 
steps 241 and 243 above to provide a faithful rendition of 
25 element 252. 

Upon determining whether the image is color enabled at 
step 241 and whether client 250 has been color 
characterized at step 243, notification element 254 may be 
provided about the integrity of color imagery currently 
3 0 being viewed by the client at a specific web site. In 

particular, at step 245 when an image such as element 252 
is color enabled and corrected, notification may be 
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provided to a client such as client 250 that the color of 
the image is accurate. If the image is not color enabled, 
at step 247 notification may be provided to the client that 
the color of the image may not be accurate. If the client 
is not color characterized or calibrated, at step 249 
notification may be provided to the client that the color 
of the image may not be accurate. Notification steps 247 
and 249 may result in the same indication to client 250 or 
distinct notifications may be used. After notification of 
client 250 at either steps 245, 247 or 249, algorithm 256 
may enter a standby mode until another web page with image 
elements is detected. Notification element 254 may be a 
part of web page 246 delivered from a network server or 
notification element 254 may be generated on device 259 for 
display on display 248. 

In a currently preferred embodiment of the present 
invention algorithm 256 may detect whether a web page such 
as web page 24 6 includes predetermined HTML tags such as 
tags 262. For example, when a web page with an image is 
color enabled, the HTML tags direct a browser to display a 
predetermined text as a headline of a certain size, such as 
the title "True Internet Color™". 

Referring now to Fig.'s 6A and SB, a screen view of a 
web page 266 having a title "True Internet Color™" (True 
Internet Color™ is a trademark of E-color Inc.) in title 
bar 264 and HTML file 270 that created it are shown. The 
presence of indicator 268 such as "True Internet Color" in 
a tag such as tags 262 may enable algorithm 256 to 
recognize that images on page 266 are color enabled. Thus 
when a web page includes the title "True Internet Color™" 
the image is considered to be color enabled. The present 
invention is not limited to recognition of HTML tags 
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directed at the title "True Internet Color™/' but rather, 
indicator 268 may use any predetermined tag configuration 
such as HTML tag, or web image tag configuration. 

<html> Marks the beginning 

of an HTML-coded 
file 



<head> 



10 



15 



20 



<title>Shop-o-rama True Internet 
Color (r) </title> 
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and may contain 
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displaying window's 
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Marks the end of 
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formatting 
information, such 
as style sheets. 

Marks the end of an 
HTML -coded file 



212546 



23* 



154025-0016 



To determine whether an image such as page element 2 52 
is color enabled via ICC color correction information, a 
system according to the present invention such may detect 
whether ICC profiles (for the device characteristics of the 
5 reference image as represented on the reference device) are 
embedded within an image file, such as element 252 , based 
upon an ICC profile format specification. In particular, 
the present invention may detect data 253 stored in ICC 
profiles such as profiles 255, which are described in the 

10 ICC profile specification. ICC profiles such as profiles 
255 are device profiles that can be used in pairs to 
translate color data created on one device such as device 
257 into a native color space C of another device such as 
device 259. More specifically, an ICC profile such as 

15 profile 261 may be provided for each device such as device 
257 and may be used according to the present invention to 
transform color image data such as element 252 from a 
device-dependent color space to the profile connection 
space, and to transform color image data from the profile 

20 connection space to another device-dependent color space. 
ICC profiles such as profiles 255 for the device 
characteristics of the reference image as represented on 
the reference device may be embedded .in the image file such 
as element 252 or stored in a memory in a connected 

25 computer such as device 259. For example, the ICC profiles 
could be stored in a memory, accessible by a CPU, and 
associated with the image instead of embedded. 
Additionally, it should be noted that ICC profile can be 
accessed by the client from a variety of other sources such 

3 0 as network interface or from other external devices via a 
modem interface . 



212546 



24 



154025-0016 



To determine whether an image is color enabled-even 
without an embedded or associated color profile a system 
according to the present invention may detect whether the 
image is in a known color space, such as sRGB . sRGB is a 
well-defined color space, includes various versions such as 
sRGB 64, and is further defined at http://www.srgb.com. One 
skilled in the art will recognize that implementation of 
the present invention may be used with any kinds of images, 
including but not limited to those subject to compression 
techniques, such as GIF, PNG or JPEG formatted images. 

Referring to step 243, the present invention 
interrogates the client system to determine if that system 
is characterized and calibrated to the same state, or to a 
different but known state. In other words, the present 
invention detects the presence of a transfer function in 
the client system, i.e. in the hardware or software (or 
the combination of hardware/software and human perception) . 
In particular, the present invention checks file entries 
and registries, or pointers to such entries and registries, 
to determine whether characterization parameters are 
present. A flag, initialized to a set value, signals 
whether the client system has been characterized. For 
example, in a typical embodiment, a binary flag initialized 
to a zero value is set to a non-zero value when the present 
invention detects the client system is characterized. In 
accordance with the present invention, a client may use any 
type of conventional or newly developed color calibration 
system including, for example, the interactive color 
calibration method disclosed in U.S. Patent No. 5,638,117. 

Referring to step 16, the present invention then 
determines the whether the system is acting in accordance 
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with steps 12 and 14 above to provide color accuracy. In 
particular, once the present invention confirms that the 
presence of color correction information in the displayed 
image (step 12) and the image has been adjusted, as needed, 
5 to display properly on the calibrated or characterized 
client system (step 14) (i.e. color accuracy is being 
provided for in step 16) , a notification is displayed to 
the user (step 18) . When the software process determines 
that color accurate display is occurring on all or part of 

10 the image,, then an appropriate notification is made to 

inform the user that color correction has occurred where 
marked. One skilled in the art will recognize that the 
particular type of notification is not critical to the 
invention. The notification may be visual or non- visual 

15 notification (e.g. audio) . For example, the visual 

notification may be an icon that provides users with a 
visible indication about the integrity of color imagery 
currently being viewed by the client at a specific web 
site. It does this by briefly flashing the cursor for a 

20 fraction of a second to indicate if whether or not the page 
is being viewed utilizing color correction. This icon can 
be implemented in addition, or instead, in the OS, in a 
web-enabled application, or in a browser (when implemented 
on as a client-side application) ; or it can be implemented 

25 as an image, tag, program, or watermark embedded within a 
web page by the web server or by any of the links between 
server and client within the network infrastructure. 

For example, when a user requests a Web page from a 
web site enabled by the present invention, the HTML is sent 
30 to the client directly from the web site's main servers. A 
specially attached URL link calls up color-corrected images 
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from the hosted server, and the client's browsers integrate 
the two pieces automatically. Thus, in accordance with the 
present invention, the notification not only provides 
notification feedback to the user, but also reinforces a 
message of data fidelity to the end-user in determining 
whether the color data is accurate or not. The present 
invention has applicability for any client viewing or 
display application where color accuracy is important to 
the communication of information. Examples include, but 
are not limited to, viewing artwork, fashion, cosmetic, 
logo or brand colors, paint, photography and other color- 
sensitive information over a medium such as the Internet 
where content viewer and content creator are disconnected 
by physical space and/or time. Although, for illustrative 
purposes, the present invention is described and 
illustrated utilizing web pages hosted on a server and 
displayed with color correction on a client, the invention 
is not limited to such a configuration. Rather, the 
present invention would apply equally well to images 
displayed on any imaging peripheral including transmissive, 
.reflective, and other source and/or client imaging 
technologies. Moreover, the present invention would also 
apply to images not viewed by the Internet, such as images 
within computer applications, TV, broadcast, or other 
client output media of any kind, including printed output. 
The present method would apply to both digital images and 
analog images including both real and synthetic images 
authored for, and/or viewed on, a client system. 

The present invention may be implemented as a client - 
based notification system 30 as shown in FIG. 7 or server- 
based notification system 50 as shown in FIG. 8. With 
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respect to a client-based notification system, the present 
invention may be installed on a client system such as 
client 38, peripheral, and/or other output technology that 
has various states of visual display to notify the user 
about the state of color correction for digital images 
output or displayed. Referring to FIG. 7, a functional 
block diagram of a client-based notification system 30 for 
providing critical end user feedback as to the color 
correction status of imagery on a client display is 
illustrated. Client-based notification system 30 is shown 
with hosted color server 32, mirrored server 34, non- 
mirrored server 36 and clients 38, 40, 42, 44 and 46 which 
represent the various types of clients, that is, clients 
such as 38 and 4 0 which include the client based 
notification techniques of the present invention (indicated 
by the term "icon"), clients 38, 40, 42 and 44 which are 
characterized for color, clients 42 and 44 which have a 
known transfer function and client 46 which is not 
characterized, has no known color transfer function and 
does not include a notification system according to the 
present invention . 

Icon 66 depicted in Fig. 9(b), provided by client 38 
is preferably initiated to a non-corrected state. When 
client 38 sends a request to mirrored server 34, which 
mirrors hosted color server 32, a color corrected requested 
image is sent from hosted color server 3 2 to client 3 8 
including a color notification tag, such as a specific HTML 
title bar flag. The Web page HTML from server 34 includes 
a color notification tag within its HTML tags to indicate 
in the title bar that the images to be sent by server 32 
have been enabled for color correction. For example, as 



212546 



28' 



154025-0016 



shown in FIG. 6A, the title bar of the web page may include 
a notification in its title bar, such as "True Internet 
Color", in addition to other terms such as the name of a 
related company, to indicate color correction. As noted 
5 above, one skilled in the art will recognize that the 
present invention is not limited to the detection of 
predetermined HTML title tags, rather, any device capable 
of detection may be used as the color notification tag. 
Upon arrival at the client 38, the present invention 
10 detects the color notification tag by evaluating the HTML 
tags sent from server 34 to determine whether the image 
delivered from server 32 has been color correction enabled 
by detecting the True Internet Color tag in the title. It 
also checks whether client 38 has been color characterized 
15 or calibrated to a known state. If both conditions are 
true, an icon such as icon 66 depicted in FIG. 9(b) is 
changed to a corrected state as depicted by icon 64 in FIG. 
9(a). In contrast, when client 38 sends a request to a 
site * providing non color corrected pages, such as non- 
20 mirrored server 36, which is does not include the special 
HTML tags, such as "True Internet Color" to indicate color 
correction, then icon 66 remains unchanged from its non- 
corrected default state. 

Still referring to FIG. 7, local client 40 is 
25 characterized but includes no applet incorporating the 
present invention for notification as indicated by the 
phrase "no-icon". Local client 40 is in direct 
communication with mirrored server 34 and hosted color 
server 32. Local client 40 provides no notification icon. 
3 0 When local client 4 0 sends a request to mirrored server 34, 
the requested image is color corrected and sent back by 
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hosted color server 32, with no notification icon on client 
40. When local client 40 communicates with non-mirrored 
server 36, the requested image is not color corrected, and 
there is no notification icon to this effect. 

Client 42. is characterized and includes a known 
(characterized or calibrated) transfer function but no 
applet incorporating the present invention for 
notification. Client 42 is in direct communication with 
mirrored server 34 and non-mirrored server 36 and in direct 
communication with hosted color server 32 via redirection 
requests from mirrored server 34. Client 42 provides no 
notification icon. When client 42 sends a request to 
mirrored server 34, the requested image is corrected. 
However, no notification indicating color correction is 
sent back to client 42. When client 42 sends a request to 
non-mirrored server 36, the requested image is not color 
corrected and no notification of color correction is sent 
back to client 42. In such case, the title bar of the web 
page would not indicate a color corrected image. 

Client 44 is characterized and includes a known 
(characterized or calibrated) transfer function and 
includes an applet incorporating the present invention for 
notification. Client 44 is in direct communication with 
mirrored server 34 and non-mirrored server 3 6 and in 
direct communication with hosted color server 3 2 via 
redirection requests from mirrored server 34. Client 44 
provides a notification icon. When client 44 sends a 
request to mirrored server 34, the requested image sent by 
hosted color server 32 is color corrected. In such case, 
the title bar of the, web page would indicate a color 
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corrected image . Notification indicating color correction 
is sent back to client 44 indicating a color corrected 
image being displayed. When client 44 sends a request to 
non-mirrored server 36, the requested image is not 
corrected and no notification of color correction is sent 
back to client 44. In such case, the title bar of the web 
page would not indicate a color corrected image. 

Client 46 is neither characterized nor includes an 
application incorporating the present invention for 
notification. Client interacts with non-mirrored server 36 
only and provides no notification icon. When client 46 
sends a request to non-mirrored server 36, which is not in 
mirror communication with hosted color server 32, the 
requested image sent by non-mirrored server 36 is not color 
corrected and no notification is provided to the client 46. 
In such case, the title bar of the web page would not 
indicate a color corrected image. 

Referring now to FIG. 8, a functional block diagram of 
a server-based notification system 50 for providing 
critical end user feedback as to the color correction 
status of imagery on a client display is illustrated. With 
respect to a server-based notification system, the present 
invention may be installed on a web site server to notify 
the user about the state of color correction for digital 
images output or displayed. In particular, the icon of the 
present invention can be implemented in an image, tag, 
program, or watermark embedded within a web page by the web 
server or any of the links between server and client within 
the network infrastructure. Server-based notification 
system 50 is shown with hosted color server 52/ mirrored 
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server 54, non-mirrored server 56 and clients 58, 60, 62 
and 64. The icon of the present invention is installed in 
hosted color server 52 and mirrored server 54 and not in 
non-mirrored server 56. 

5 When client 58 sends a request to hosted 52, client 58 

may communicate through some means that it is a client that 
is of a specific, known calibration. This notification may 
be included in the HTML stream sent by the browser, or via 
any other method. In that case, if a color corrected image 

10 is sent from hosted color server 52 (or from mirrored 
server 54) to client 58, then an icon is also sent by 
mirrored server 54 or by hosted color server 52 to indicate 
that the image has been corrected. In contrast, when 
client 58 sends a request to non-mirrored server 56, which 

15 is not in communication with hosted color server 52, non- 
mirrored server 56 does not include an icon (or sends an 
icon indicating that no color correction has occurred) . 

In accordance with an alternative embodiment of the 
invention, client 60 is characterized and includes an 
20 applet incorporating the present invention for providing 
notification. Local client 60 is in direct communication 
with mirrored server 54 or hosted color server 52, which 
also includes the notification icon. When client 60 sends 
a request to mirrored server 54 or hosted color server 52 

2 5 as described above, the requested image is color corrected 

and sent back by web site server along with a notification 
icon indicating a corrected state. Mirrored server 54 also 
sends the HTML tags indicating color correction and the 
icon on client is changed to indicate the corrected state. 

3 0 Logic is implemented to arbitrate between the state of the 
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two icons (server-based and client-based) . For example, in 
one embodiment either the server or client based 
notification icon may take precedence while in another 
embodiment a third icon, similar to the icons shown in 
5 FIGS. 5(a) and (b) , may be used to indicate the presence of 
a different level of color correction based on the presence 
of both server and client based notifications. 

Client 62 is neither characterized nor includes an 
application incorporating the present invention for 

10 notification. When client 62 sends a request to server 54, 
then either server 52 would use HTML tags to add some 
watermark or other image to the web page to indicate color 
accuracy; or server 52 would request web server 54 to send 
an image which already has an icon superimposed on the 

15 image sent by server 54. When client 62 sends a request to 
non-mirrored server 56, the requested image sent by non- 
mirrored server 56 is not color corrected and no 
notification is provided to client 62. In such case, the 
title bar of the web page would not indicate a color 

2 0 corrected image, and no icon would be sent by non-mirrored 
server 56. 

In accordance with an alternative embodiment of the 
present invention, depending upon the relationship between 
the mirrored server 54 and hosted color server 52, hosted 
25 color server 52 may require mirrored server 54 to identify 
images not color corrected. In such case, a server-based 
icon can be sent to a client to indicate images which are 
not color corrected. 

In accordance with another alternative embodiment of 
30 the present invention, multilevel icon certifications may 



212546 



33 



154025-0016 

be provided. In particular, multilevel icon certifications 
can be utilized to distinguish between icon certifications 
between various entities providing for color correction. 
For example, when hosted color server 52 provides color 
5 correction, an icon identifying not only color correction, 
but correction specifically provided by a particular hosted 
color server, is sent to the client. On the other hand, if 
color correction is provided by another entity, an icon 
identifying color correction, without identification of a 
10 specific entity providing for correction, is sent to the 
client . 

PARTIAL FILE PROCESSING 

To increase the speed of providing color corrected 
images to a user, commercial server 18 of Fig. 1 may store 

15 partially preprocessed data files such as image files or 

may partially preprocess data files on-the-fly. Similarly, 
only that portion of a compressed image file necessary to 
correct the color need be decompressed for color correction 
thus expediting the process. In general, images available 

2 0 on network 200 may conform to one or more compression 

standards to permit greater throughput of information and 
higher inter- connectivity . Several standard image formats 
such as JPEG (Joint Photographic Experts Group) , or MPEG 
(Motion Picture Experts Group) , or GIF (graphical 

2 5 interchange file format) may be found on a network such as 

the Internet. 

Referring now to Fig. 10 process 3 00 is a conventional 
technique for image compression such as, for example a JPEG 
format. Image 3 02 may be any image such as a line drawing 

3 0 a black and white or color photograph or any other image. 
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Image 302 is compressed by compression device 304 according 
to a compression standard, here JPEG standards and results 
in JPEG file 306. A compressed file such as a JPEG file 
306 may have several identifiable elements, such as 
luminance element 3 08, color element 310, and miscellaneous 
elements 312 and 314. Miscellaneous elements such as 
element 312 may include information unnecessary for the 
ultimate display of a color corrected images over a 
network, such as a thumbnail image. Other compression 
standards may have different elements and may function 
similarly for color spaces using different specification 
characteristics . 

A compressed image file such as image file 316 may be 
partially uncompressed to expedite color correction as 
shown in Fig. 10. At step 317, file filter 318 processes 
image file 316 to separate compressed luminance elements 
and compressed color elements such as compressed luminance 
element 316L and compressed color element 316C 
respectively. Unnecessary file elements such as 
miscellaneous elements 312 and 314 of Fig. 10 may be 
discarded to expedite processing. Compressed color element 
316C is passed along at step 319, no processing of 
compressed color element 316C is required according to a 
currently preferred embodiment of the present invention. 
However, use of other color spaces or compression 
techniques may require some processing of a generally 
unused element such as compressed color element 316C and 
may result in processed elements such as element 322. 

At step 321 one or more file elements needing 
correction such as luminance element 316L may be 
decompressed to form correctable elements such as 
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correctable element 320. Following step 321 alternate 
paths may be used. 

In a first embodiment of the present invention at step 

325, correctable element 320 and element 322 may be 
combined using data combiner 324 to form intermediate file 

326. Intermediate file 326 has shared elements with 
compressed image file 316. Correctable elements such as 
correctable element 320 may be uncompressed awaiting 
correction and elements not requiring processing such as 
element 322 may be combined in one or more uncorrected 
intermediate format files such as uncorrected intermediate 
file 326. Upon receipt of user color data such as display 
calibration or characterization data 38 of Fig. l, 
uncorrected intermediate file 326 may be processed at step 
323 to correct correctable elements such as correctable 
element 320 according to display calibration or 
characterization data 38 which may be for a specific user 
only or it may be a net correction file as discussed below. 
The result of step 323 may be a corrected intermediate file 
such as corrected intermediate file 328. 

At step 327 corrected elements of corrected 
intermediate file 328 may be compressed according to the 
compression technique being used. The resulting file 
composite corrected image file 332 is a luminance corrected 
image file according to the compression technique being 
used . 

Referring again to Fig. 1, correction of image file 
52F for display may include two or more alternate methods. 
In a first, display calibration or characterization data 
18D of the authoring display 18M may be included with or 
applied to an image file creating a master corrected image 
file such as file 237 or uncorrected intermediate file 326 
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of Fig. 10. Upon receipt of user display calibrat ion or 

characterization data 238 final correction of image file 
237 may be accomplished. Thus file 237 may be displayed on 
display 206 with corrections included for display 208 and 
5 display 206. Alternatively, author display calibration or 
characterization data 236 may be combined with user display 
calibration or characterization data 238 to create a net 
correction file 239 that may be applied to any images 
authored on display 208 to achieve accurate image display. 

10 In a second embodiment of the present invention at 

step 325, correctable element 320 may be corrected to form 
corrected element file 330. .As discussed above, upon 
receipt of user color data such as display calibration or 
characterization data 38 of Fig. 1, correctable element 320. 

15 may be processed at step 323 according to display 

calibration or characterization data 38 which may be for 
the user only or it may be a net correction file as 
discussed . 

At step 327 corrected elements such as corrected 
20 element file 330 may be compressed according to the 

compression technique being used. Compressed corrected 
element file 334 may be combined with element 322 in 
combiner 336 to form composite corrected image file 338. 
composite corrected image file 332 and composite corrected 
25 image file 338- should yield identical images when displayed 
on display 22 of Fig. 1. 

Starting from an original image file, this technique 
may also be applied by originally compressing a portion of 
the image file. The uncompressed portion and the 
3 0 compressed portion and the authoring station color 
characterization data may then be combined into an 
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intermediate file format to permit fast correction and 
complete compression for transfer to a user. 

IMAGE PREPROCESSING SETS 

In another aspect, the present invention includes a 
5 technique for organizing display devices into subsets 
according to their characteristics and thus limit image 
correction to a finite number of perceptually uniform 
subsets. An image presented on display devices within a 
subset should be indistinguishable to a user on all devices 

10 having characteristics within the subset. Analysis of the 
relationship between gamma, black-point and luminance for 
display devices such as monitor 3 53 and monitor 361 
demonstrated that within a gamma black-point plane such as 
coordinate system 3 64 of Fig. 12, subset areas having 

15 limited variance luminance may be described. 

Referring now to Fig. 11, in a currently preferred 
embodiment of the present invention network 350 includes 
two or more electronic devices such as devices 352, 354, 
356, 358, 360 and 362. Electronic devices 352, 354, 356, 

20 358 and 360 further include display elements such as 

monitor 353, monitor 355, display 357, display 359, monitor 
361 and display device 363 respectively. Display elements 
such as monitor 353, monitor 355, display 357, display 359, 
monitor 361 and display device 363 may be characterized 

2 5 using two or more parameters such as gamma black-point and 
luminance for CRT displays. Non-CRT display devices may 
use different parameters. 

Referring now to Fig. 12 coordinate system 3 64 
includes characteristic axes 366 and 368 illustrating the 

30 interrelationship between characteristic 370 and 372 
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respectively. For conventional cathode ray tubes displays 
such as monitor 353 coordinate system 364 has two 
characteristic axes 366 and 368 for characteristic 370 
(gamma) and 372 (black point) respectively. 
5 One or more subset areas such as subset 3 74 may be 

used to identify areas of luminance having nearly- 
indistinguishable image parameters for CRT display devices 
such as monitor 361 and display device 363. Subset areas 
such as subset 3 74 and subset 376 may overlap. In a 

10 currently preferred embodiment of the present invention, 
subset overlapping is required to completely cover the 
characteristic space describing the imaging or display 
device. As characteristic 370 (gamma) and 372 (black 
point) move away from origin 3 71, subset areas such as 

15 subset 378 may include larger or smaller areas than subset 
areas closer to origin 371 such as subset 374. 

Display device parameters 370 (y) and 372 (black point) 
may be obtained from display device characterization as 
discussed above. Thus, when a user device 3 52 requests an 

20 image from a correction enabled server 354 , server 354 may 
display parameters such as characteristic 370 (gamma) and 
372 (black point) from user display calibration or 
characterization data 373 and may provide a pre-corrected 
image such as pre-corrected image 375 according to which 

25 subset the users display device may be grouped in. A 
server so enabled may store a finite number of pre- 
corrected images such as pre-corrected images 380 to 
expedite fulfilling a user request for a corrected image 
according to the subset of the users display device. 

3 0 Referring now to Fig. 13, in an alternate embodiment 

of the present invention, a correction enabled server such 
as device 354 may use a combination of pre-corrected images 
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in local storage to provide to display devices having 
subsets in area 386, pre-corrected images in central or 
network storage for the smaller yet significant number of 
display devices having subsets in areas 384 and on-the-fly 
5 image correction display devices having subsets in areas 
382. Other combinations of image correction and storage 
may be used. Distribution area 386 may also be 
characterized in terms of one or more parameters of display 
3 53, input or output device, or in terms of some other 
10 important and useful characteristic used to subset display 
devices or images. The distributions need not be limited to 
a unidimensional characteristic, they may be 
multidimensional and encompass many display or imaging 
parameters . 

15 

DETERMINING INPUT/ OUTPUT PARAMETERS OF ANY DISPLAY 

Referring now to Fig. 14, in another aspect, the 
present invention includes a method and apparatus to 
establish the input/output characteristic (I/O) and 

20 operating point such as point 392, and to determine I/O 

curves of displays such as I/O curves 394 and 3 96 that may 
be applicable to any type of display technology such as 
display 357 of Fig. 11. It can be used in conjunction with 
visual or instrumental characterization or calibration 

25 methods. The method described in this invention is not 

limited to any particular display technology, but it will 
be described using Liquid Crystal Display (LCD) technology 
as an example. An application according to the present 
invention may run 

30 Referring now to Fig.'s 15 and 16, an operating point 

determination method ' according to the present invention 
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includes two parts. The first part, data reduction 400, 
determines the appropriate subset of orthogonal basis 
vectors that describe the space of measured I/O curves such 
as I/O curve 394 along with the coefficients used to 
5 synthesize the curves. In principle data reduction 400 
need only be done once providing the curves used in the 
analysis span the space of all possible I/O curves. It is 
this property that makes this a robust general method. In 
practice, data reduction 400 characterizes a large set of 

10 display I/O curves, or vectors, using a smaller set of 

orthogonal basis vectors. If each I/O curve is represented 
by N input points, then there is a possibility that the 
space containing all measurable I/O curves is N- 
dimensional. Rarely is an I/O characteristic N- 

15 dimensional, usually the dimension is something less than 
N. 

The second part of an operating point determination 
method according to the present invention, data application 
4 02, describes the determination of a specific I/O curve 
20 such as I/O curve 3 94 for a users display such as display 
3 57. There are no constraints, both visual and 
instrumental approaches are possible. 
Data Reduction 

Referring now specifically to Fig. 15 and 17, at step 
25 401 data reduction according to the present invention tests 
displays such as display 406 and measures screen luminance 
L, also called screen brightness, as a function of known 
digital input values DV for neutral or near-neutral colors. 
Luminance versus digital input value data may also be 
3 0 compiled from existing data such as manufacturers data 
where available. A plot such as graph 412 of measured 
luminance L, in cahdelas/m2, versus DV yields a measured 
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I/O transfer function such as I/O curve 410 of Fig. 18. 
Screen luminance may be determined using light measuring 
device 408 which may be a spectroradiometer, colorimeter, 
or other form of light measuring device. Such measurement 
could also be done on a relative basis by comparing the 
displayed luminance relative to some reference, such as a 
"gray scale" or series of know areas of reflectance. For 
I/O curves of specific display color primaries, each 
primary color would be displayed instead of the neutral 
color. Display color primaries may be red, green and blue 
for a conventional RGB system, other systems may be used 
such as CMY, YUV or any other suitable combination. 

The 1 number of input DV to be sampled should be 
sufficient to sample any curvature of the I/O curves such 
as I/O curve 410. In a currently preferred embodiment of 
the present invention fifteen uniformly spaced input DV 
levels have been used, but specific display devices might 
dictate more or fewer levels. The actual number will 
depend on the instantaneous slope such as slope S of I/O 
curve 410. A higher slope such as S x suggests more samples 
be used to adequately measure the curve, and, with a lower 
slope such as S 2 few samples may be used. 

A sufficient number of different display devices that 
span the range of I/O characteristics of interest need to 
be measured or formulated from useful models. The measured 
data can be one device such as display 406 measured at a 
multiplicity of display control settings, e.g. brightness 
and contrast, or many different displays such as monitor 
353, monitor 355, display 357, display 359, monitor 361 and 
display device 363, other combinations are possible. 

At step 403 data 414 may be tabulated in a matrix 
format such as matrix 416 where rows such as row 418 may 
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correspond to each display such as display 406 and/or 
display setting, and columns such as column 420 may 
correspond to input data DV. Matrix entries such as entry 
422 may be normalized luminance values such as output 
5 luminance L. Data matrix 416 may also be "inverted" , 

resulting in columns such as column 420 representing the 
interpolated luminance values and the matrix entries such 
as entry 422 are the input digital values. Consistent with 
the spirit of the invention other normalization techniques 
10 may be used. In a currently preferred embodiment of the 
present invention fifteen input DV values and twenty one 
different display conditions are used yielding a 21 by 15 
matrix . 

Step 403 may also include data processing to include 

15 normalized display luminance versus normalized DV for each 
display and/or display setting. Input data DV and output 
data L may be normalized by dividing by the maximum value 
in each case. This normalization yields a range of zero to 
1.0 for both input and output values. 

20 Matrix 416 must be processed at step 405 before PCA. 

First, column average 424 of each column 420 of data matrix 
416 is determined. The column average is subtracted from 
each row 418 of data matrix 416. This new matrix is called 
reduced matrix 426. A covariance matrix 428 is computed by 

25 pre-multiplying reduced matrix 426 by its transpose, 

transpose matrix 427. PCA is then performed on transpose 
matrix 427. Any suitable conventional software programs 
may be used to carry out the computations. 

At step 407, Principle Component Analysis (PCA) may be 

30 performed, (a.k.a. eigenvectors, characteristic vectors) on 
data matrix 416. The basic idea of PCA is to represent the 
large collection of measured I/O curves or vectors, by a 
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smaller set of orthogonal basis vectors. A weighted linear 
combination of these basis vectors are then used to 
synthesize the complete set of I/O vectors. 

In a currently preferred embodiment of the present 
5 invention after PCA at step 407, three vectors vi, v 2 and 

v 3 , plus a mean vector v m , accounted for about 99.88% of the 
variance in the different I/O curve shapes. This signifies 
that mean vector v m plus some weighted linear combination of 
basis vectors v lf v 2 and v 3 , may be used to synthesize each 

10 of the twenty one I/O curves used to generate the data 

quite accurately. In practice, the number of vectors can 
be more or less than three, depending on the variety of the 
measured" or model curve shapes (the vector subspace) used 
in the analysis, and, the precision of the fit required. 

15 Mathematically, I/O curve, L j , at input, j, may be 

written as the linear combination of the average vector and 
the three basis vectors as shown in equation 430. 

430 

Lj^Vj + ai vij + a 2 V2.j + aj vj., 

In equation 430 a 1# a 2 and a 3 are the vector weights 
2 0 and v lr v 2 and v 3 are the first three basis, or 

characteristic, vectors determined from PCA in step 407. 
Since mean vector v m and the three basis vectors v x , v 2 and 
v 3/ are fixed, only three scalar values a i7 a 2 and a 3 are 
needed to describe the complete I/O curve such as I/O curve 
25 410. This is a significant compaction of the data needed 
to describe the I/O curve. Without this representation it 
would take at least fifteen values, in our case, to 
describe each curve . 

At step 409 three coefficients a x , a 2 and a 3 in 
30 equation 430 are determined. Coefficients a x , a 2 and a 3 are 
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not necessarily related to any specific point on the I/O 
curve depending on original data matrix 416. If data 414 
were input digital values then there may be some simple 
relationship between coefficients, ai, a 2 and a 3 and some 
5 point on curve 410. For a practical application 

coefficients ai, a 2 and a 3 need to be "mapped" or connected 
to some measurable points on the I/O curve. These points 
can be determined using visual methods or instrumental 
methods . 

10 For example, coefficients a lf a 2 and a 3 may be 

determined as follows. For each of twenty one I/O curves 
initially measured or gathered, the DV's yielding 25%, 50% 
and 75% relative screen luminance may be determined by 
inverse linear interpolation of each I/O curve. That is 

15 three DV's for each component channel such as red, green 

and blue channels in a conventional RGB system. The other 
data set is the vector coefficients needed to synthesize 
the curves. Data set 434 now includes three DVs, DV 25/ DV 50/ 
and DV 75 , and three vector coefficients a i7 a 2 and a 3/ for 

20 each I/O curve 410 and the task is to relate DV and 
coefficients . 

In another aspect of the present invention, 
alternative DV sets may be used to more accurately 
characterize displays. DV 25/ DV 50 , and DV 75 may be used for 

25 CRT displays and DV 33 , DV 50 , and DV 66 may be used for LCD 
displays. Other DV sets may be used successfully. 

One technique is using polynomial regression to solve 
for b k in equation 432. 

432 aic = (bxDVss + b 2 DV 50 + b 3 DV 75 ) 2 

3 0 Other equations may be fitted by either regression or 

a variety of other curve or function fitting operations. 
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Another possibility is to use some functional form 
representing a physical model, or, use PCA again. Yet 
another method might be to linearly or nonlinearly 
interpolate values, or interpolate a k from a 
multidimensional table . 

At step 411, data set 434 includes a set of three 
vectors v lt v 2 and v 3 , plus mean vector v m , and an equation 
for each coefficient a x , a 2 and a 3 that relate the DV's 
determined from the matching by users or by an instrument, 
to the coefficients, or weights, needed to synthesize or 
construct the curve. This needs to be done only once and 
may be put in a database 43 6 or stored in any other 
suitable storage system as shown in Fig. 16. 

I/O Curve Construction 

Once database 43 6 has been constructed a display I/O 
curve 410 for each color channel or neutral gray may be 
created. The I/O curve thus constructed can be written to 
a file, data set 434, computer memory 438, or otherwise 
stored for further use in system 440 according to data 
application method 402 as part of a profile for color 
management or image management. Image management can 
comprise any archiving of images or any form of image 
processing, either spatial or temporal. 

Step 413 of data application 402 is to optimize the 
setup of the display such as display 406. It is possible 
for users to misadjust the display controls such as 
brightness control 444 and contrast control 442 so the high 
luminance levels are on shoulder 446 of T/0 curve 410, and 
many of the low luminance levels are on toe 448 or -lower 
curved part. To optimize operating point 450 of display 
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406 data for one or more setup screens such as data 452 may 
be transmitted to user 404 to adjust contrast control 442 
and brightness control 444. 

Referring now to Fig. 18, a setup screen 454 permits 
5 user adjustment of display 406 so there is a 

differentiation of two or more adjacent, or very close, 
light (brightness) levels at high and low DV. Setup screen 
454 may include an array of patches or areas 456 and 458 
either of gray or other display primary colors or color 

10 mixtures. Areas 456 and 458 may be closely spaced in the 
highlights and shadow areas of the I/O curve. The user is 
instructed to adjust the "brightness" and "contrast", or 
any other display controls, to assure maximum color or 
luminance difference between the areas. This will help the 

15 user to operate the display off shoulder 446 or toe 448 of 
I/O curve 410 thereby increasing display dynamic range. 

For a conventional LCD display, the "brightness" knob 
generally controls a fluorescent lamp or other light source 
behind the LCD and the "contrast" knob generally controls 

20 the operating point on the LCD. Therefore, the first 

adjustment should be the "contrast" to prevent the user 
from operating the display on the shoulder of the curve. 
This may be counterintuitive because it apparently causes a 
decrease in the overall screen brightness. However, many 

25 LCD displays have a maximum luminance of about 50% greater 
than a bright CRT. A "bright" CRT may have a luminance of 
about 100 cd/m 2 --the sRGB standard is 80 cd/m 2 - -while many 
of the better quality LCDs have a luminance value of about 
150 cd/m 2 . 

30 Area 456, at 75%, 66%, or any other suitable scale 

must not impinge onto shoulder 446, and area 458 at 25%, 
33% or any other suitable scale for example, must not 
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impinge into toe 448. Achieving an optimum display setting 
is not critical. 

At step 415 user 404 is queried for inputs in order to 
determine the values for calculating the basis vector 
5 coefficients such as a lt a 2 and a 3 . Any combination of 
three or more points between 0% and 100% may be suitable. 

In another embodiment of the present invention, three 
points from user visual match data may be used to determine 
coefficients a i7 a 2 and a 3 as shown for example in Encreldrum 

10 & Hilliard USP 5,638,117. Since there are three vectors in 
the I/O curve synthesis, at least three points are need to 
estimate the three coefficients. With more or less number 
of vectors describing the I/O curves, more or less points 
may be used. There is not necessarily a one-to-one 

15 correspondence between the number of vectors and the number 
of points used. One possibility is to display three, 25%, 
50% and 75% halftone screens for each of the display 
colors, red, green, and blue with a number of continuous 
tone areas immersed in the halftone background. This 

20 method is not limited to the three standard so-called 

primary colors red, green and blue. In fact it is possible 
to construct a display using cyan, magenta and yellow that 
match commercial printing standards in order to get a 
better match or other color systems may be used. This 

2 5 approach would work just as well with this display or any 
display that used one or more colorants or primary colors. 
Also, the number of points and the percentage values can be 
changed to increase precision, or accuracy of coefficient 
determination with any given display such as 33%, 50% and 

30 66% or, black, 33%, 50%, 66% and white. The user may 

select one of the embedded patches such as patch 460 that 
matches either in color or luminance (brightness) of the 
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surrounding halftone 462. Since the DV for each displayed 
patch is known, these match values determine the DVs that 
match the 25%, 50% and 75% surround halftone screens. It 
is also possible to use an instrument to make this 
comparison. Other arrangements of continuous tone and 
halftone areas are possible. For example it is possible to 
keep fixed a continuous tone patch such as patch 460 and 
make an adjustment of the surrounding halftone such as 
halftone 462 so there is match between the patch and the 
halftone . 

In still another embodiment of the present invention, 
a series of patches 4 64, or images, of known relative DV 
surrounded by a halftone 462 of known fractional area is 
presented on a screen 454. An observer is asked to select 
one of the patches that matches the halftone background. 
This matching process may then be repeated for two or more 
other surround halftone values yielding at least three DV- 
relative luminance pairs. Fractional areas of 25%, 50% and 
75% are useful but other values may be better in different 
situations. 

In still another embodiment of the present invention a 
radiation or light measuring device such as light measuring 
device 408 may be used and display 406 may be controlled by 
a computer 466 to present all possible light (color) values 
in an automatic method. Computer 4 66 may be programmed to 
perform a search to find a displayed area 458 that is 
closest in luminance to a reference luminance, say 75% of 
the maximum luminance. For popular eight bit systems this 
does not mean that all 256 levels need to be presented. A 
binary search method would be very rapid, only requiring 
the display of patches equal to the number of hits of 
radiant resolution. For an 8 bit display this would 
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required the display of eight areas, at most, to find the 
closest input value to the 75% reference value. This 
process can be repeated for as may values or match points 
as necessary. Other search methods can be used, for 
5 example, some form of table lookup. 

At step 417 vector coefficients a lf a 2 and a 3 may be 
calculated from regression equation 432, or from a lookup- 
table or tables, using DVs as independent variables, or 
possibly the relative luminance obtained by making a 

10 halftone-patch match. Other forms of database or data 
calculations may also be used. 

At step 419 equation 430 may be used to calculate the 
display I/O curve such as I/O curve 410 at each input DV 
point, j. As in the above example, original data set 414 

15 sampled the input (DV) at fifteen points. This is usually 
not sufficient for specifying a display profile having an 8 
bit input having 256 levels. To compute all 256 or more, 
points of the I/O curve, several possibilities are 
available. If the basis vectors such as vectors v l7 v 2 and 

20 v 3 are smooth functions of the input DV they can be fit by 
polynomials or other continuous functional forms. Some 
form of interpolation is also a method that may 
successfully be- applied. Since the basis vectors are 
fixed, these need to be interpolated only once and can be 

25 stored. In the case of the functional form for the basis 
vector coefficients equation 430 now becomes equation 468 
below : 

468 

L(DV) = v(DV) + ai f 1 (DV) + a 2 f 2 (DV) + a$ f 3 (DV) 
where f x (DV) may be the polynomials representing the 
30 basis vectors v lf v 2 and v 3 and 0 < DV < 1. A polynomial 
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representation, or other functional representation of the 
mean vector may also be used. 

Reconstructed I/O curve 470 may "overshoot" and or 
"undershoot" the actual curve 410. This means that the 
5 relative luminance exceeds 1.0, or goes negative. The 

simple fix is to clip I/O curve 470 to 1 . 0 the first time 
it exceeds 1.0, and clip to 0 the first time it goes 
negative. By checking the 8 bit LUT from the middle of the 
curve toward the "ends" , one can readily determine the 

10 first "overshoot" and "undershoot" conditions. Other 
methods are possible, such as locally altering the 
transition of the I/O curve at the zero and one points. 

In the process of determining a visual match a user 
may select a patch 472 that generates an unrealistic 

15 coefficient a u . There are many ways to deal with this, but 
a simple way is to ignore basis vectors v lf v 2 and v 3 and 
just report mean vector v m . Depending on the basis vectors, 
the mean vector as a default I/O curve may be adequate for 
most purposes. 

2 0 Having now described the invention in accordance with 

the requirements of the patent statutes, those skilled in 
this art will understand how to make changes and 
modifications in the present invention to meet their 
specific requirements or conditions. Such changes and 

25 modifications may be made without departing from the scope 
and spirit of the invention as set forth in the following 
claims . 
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We claim: 

1 1. A system for providing images to a user comprising: 

2 In response to a user request to provide one or more 

3 images, determine available user color characterization 

4 data; and 

5 cause one or more images having color characteristics 

6 appropriate to the user color characterization data so 

7 determined to be sent to user. 

1 2. The technique of claim 1 wherein if user color 

2 characterization data is available user sees a first icon. 

-1 3 . The technique of claim 1 wherein if user color 

2 characterization data is not available user sees a second 

3 icon. 

1 4. The technique of claim 1 wherein color correction of 

2 the one or more images is on-the-fly . 

1 5. The technique of claim 1 wherein color correction of 

2 images is by selection of a group of one or more images 

3 from one or more groups of pre-transf ormed images. 

1 6. The technique of claim 4 or claim 5 wherein color 

2 correction of the one or more images is done to the 

3 characterization details of the user. 

1 7. The technique of claim 4 or claim 5 wherein color 

2 correction of the one or more images is done to match one 

3 of a predetermined set of color characterization 

4 parameters . 
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ABSTRACT 

The present invention provides a technique for 
providing color corrected images to a user over a network. 
The user's computer and its associated devices may be 
remotely calibrated and or characterized and the data made 
available over the network to permit multiple image 
providers to provide color corrected images to a user. A 
notification technique is also provided to notify a user 
when the image or images being displayed is color 
corrected. It is emphasized that this abstract is provided 
to comply with the rules requiring an abstract which will 
allow a searcher or other reader to quickly ascertain the 
subject matter of the technical disclosure. It is 
submitted with the understanding that it will not be used 
to interpret or limit the scope or meaning of the claims. 
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RULE 63 (37 C.F.R. 1.63) 
DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

As a below named inventor, I hereby declare that my residence, post office address and citizenship are as stated below next 
to my name, and I believe I am the original, first and sole inventor (if only one name is listed below) or an original first 
and joint inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled High Fidelity Color Images, the specification of which (CHECK applicable BOX(ES)). 

is attached hereto. 

(3 was filed on 11/12/99 as U.S.application Serial No. 09/439.482 

□ was filed as PCT international application No.PCT / / on and (if applicable to U.S. 

or PCT application) was amended on . 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, 
i as amended by any amendment referred to above. I acknowledge the duty to disclose information which is material to the 
I examination of this application in accordance with 37 C.F.R. 1.56(a) and 35 U.S.C. 102. I hereby claim foreign priority 
■% benefits under 35 U.S.C. 1 19/365 of any foreign application(s) for patent or inventor's certificate listed below and have also 
I identified below any foreign application for patent or inventor's certificate having a filing date (1) before that of the 
i application on which priority is claimed, or (2) if no priority claimed, before the filing date of this application: 

j PRIOR FOREIGN APPLICATION(S) 

PRIORITY CLAIMED 

Number Country Dav/Month/Year Filed YES NQ 



1 1 hereby claim the benefit under 35 U.S.C. 120/365 of all United States and PCT international applications listed below 
I and, insofar as the subject matter of each of the claims of this application is not disclosed in such prior applications in the 
1 manner provided by the first paragraph of 35 U.S.C. 112, I acknowledge the duty to disclose material information as 

defined in 37 C.F.R. 1.56(a) which occurred between the filing date of the prior applications and the national or PCT 

international filing date of this application: 

PRIOR U.S. OR PCT APPLICATIONS) 

Status: patented, 

Application Serial No- Dav/Month/Year pending, abandoned 

09/422,215 19/10/99 Pending 

60/108,229 13/11/98 Pending 

60/108,442 13/11/98 Pending 

60/108,444 13/11/98 Pending 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these statements were made with the knowledge that willful false 
statements and the like so make are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may jeopardize the validity of the application or any patent issued 
thereon. 
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And I hereby appoint IRELL & MANELLA LLP, 1800 Avenue of the Stars, Suite 900, Los Angeles, California 90067, 
telephone number (310) 277-1010 (direct all communications to Rachele Wittwer) and 



Attorney 


Reg. No. 


Attorney 


Reg. No. 


Norman E. Brunell 


26,533 


Flavio Rose 


40,791 


Bruce D, Kuyper 


33,937 


Benjamin Hattenbach 


41,820 


Gary Frischling 


35,515 


Andrei Iancu 


41,862 


Sharon Wong 


37,760 


Paul Backofen 


42,278 


Soyeon Laub 


39,266 


David Rosman 


43,059 


Samuel K. Lu 


40,707 


Peter Wied 


43,264 


Lisa Partain 


40,763 


Douglas Carsten 


43,534 



(all of the same address), and any and all attorneys associated therewith after this date, individually and collectively my 
attorneys to transact all business in the Patent and Trademark Office connected therewith and with the resulting patent. 
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